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In connection with display of advertising wiminJWeb,pages,jn applet is downloaded to the user's Web browser to track the user's 
interactionsjwith the Web page. Tracked user interactions include mouse cursor positiorVtime^isplay^ 

hovenn^over^uie^veitisement,3nd so on. At~an appropriate time, such as when the display "of thfTWeb page is terminated, the applet- 
forwards logged interaction information from the client to a remote server, the remote server being typically controlled by an advertiser, 
rating service or the like. As a result, the advertiser may track consumer response to advertising impressions on a Web page without 
requiring the user to download other pages. This allows advertisers to track user response to specific elements of the Web page as well as 
to better infer information about the user's interests in an effort to qualify the user prior to presenting subsequent advertising. 
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TRACKING USER MICRO- INTERACTIONS 
WITH WEB PAGE ADVERTISING 

BACKGROUND OF THE INVENTION 

Distributed computing environments are becoming a very 
5 popular mechanism for publishing information of various 
types. In such an environment, a network of several 
different types of computers is used in order to share 
access to information. Certain computers, known as 
servers, contain databases and other repositories of 

10 information. Other computers in the network, known as 

clients, act as interfaces for the human users to retrieve 
and display information. 

One particularly well known example of a distributed 
computing environment is the World Wide Web. In this 

15 environment, the Web server computers presently in use 

typically store data files, or so-called Web pages, in a 
format known as Hypertext Markup Language (HTML) . Web 
pages are transferred between Web servers and clients using 
a communication protocol known as Hypertext Transfer 

20 Protocol (HTTP) . HTML permits the Web servers, or sites, 

to handle container or document files which reference other 
files of varying formats. Using HTML, a given Web page may 
include content information in various formats . An HTML 
format file may also refer to other files, by including 

25 reference information, known as a Uniform Reference Locator 
(URL) , which specifies the location of remote Web servers 
at which the other files may be located. 

Certain Web servers, such as those maintained by 
on-line service providers such as America On Line (AOL™) 

30 or Microsoft Network (MSN™) , are an increasingly popular 
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way for people to obtain information of interest on the 
World. Wide Web. (AOL™ is a trademark of America On Line, 
Inc. of Dulles, Virginia. MSN™" is a trademark of 
Microsoft Corporation of Redmond, Washington.) Indeed," 
5 certain Web sites host search engines such as AltaVista™, 
Yahoo™, and InfoSeek™ and thus are exclusively devoted to 
guiding users through the Web. (AltaVista™ is a trademark 
of Digital Equipment Corporation of Maynard, Massachusetts; 
Yahoo™ is a trademark of Yahoo! Corporation of Santa 

10 Clara, California; and InfoSeek™ is a trademark of 

InfoSeek Corporation of Sunnyvale, California) . These 
sites are so popular that their operators provide their 
services free of charge to users of the Web, and support 
themselves typically by selling advertising space on their 

15 Web pages. Thus, an advertiser, for example, a running 

shoe manufacturer, may contract with a search service such 
as Yahoo, or an on-line service, such as AOL, to 
periodically present its ads on their Web pages in much the 
same manner that commercials are traditionally purchased 

20 from television broadcasters. 

Certain tools are presently in use by the providers of 
such services and advertisers, typically in order to 
calculate advertising rates. For example, the Web servers 
at such sites may count the number of times that the Web 

25 page containing the advertisement is displayed. 

Alternatively, an advertiser may count the number of 
visits that its own Web page receives as a result of 
linking from the original Web page advertisement, i.e., the 
number of times that users request the URL of the 

30 advertiser's Web site via the original Web page on which 
the advertisement was displayed. In the usual model of 
user interaction with a Web page, this occurs whenever the 
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user clicks (i.e., selects by a mouse input device) on a 

hypertext item. In many instances, objects such as 

graphical images or "GIFs" may be clicked on to activate 

the hypertext links. 

5 Advertisers / however , would like not only, to count a 

niombei: - of """impressions, n 6r~how~many- times—their — ^ 

advertisement^is-seen^-but^lso—to^f ind a way to track how 

effective their jLds_are-^in-attracting-consiHners ' -interest 

in their products. 

1 0 Advertisers wourd~also^~like-feo— find -a- way—to ^more 

- • y 
precisely_,gauge -abuser ' s interest- in— a-product^jas well as 

to ehtic^_th^se_3isers - who^ar^c^^ml^ly^browsing^ through the 

World Wide Web, _ without actujilly^riequiring users to ' 

download the advertiser ' s Web page. In t^sjrnanner ^ 

15 interest - in a particular prp^ctT~6r r ^>romotion- could be 

gauged7~directly from data surrounding the_ initial > 

presentation- of the advertis^ent^ 

SUMMARY OF THE INVENTION 

Br-iefiy,—the_present invention is a technique for 

20 tracking user interactions with the ^eleana^nts that comprise 

~'~ • - — ■ — — — > 

a Web^page^advertisement. As a result, "an advertiser ^may 

• . . _ x 

understand - (make—inf erences~~as" to) what^motivat^srusers to 

pay initial" attention to and/or otherwise in^teract^wi^h Web 

. _ ____ . 

page a dvertisi ng. % 

25 The invention, in particular, tracks any sort of user 

"micro-interaction" with the advertisement. .Thejuser 
interactions which—are tracked, for example, may include 
mouse movement, mouse clicks, arid other mouse activity such 
as it relates to elements in the ad. These elements may % 

30 include various display items such as graphicsT pictures;, 
or words, or may include user prompting items such as > 
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menus; buttons , or slides. - Elements also may include 
defin^d^ regions of the advertisement J) 

The activities monitored may include how long an j 
ob j ec t is "displayed / which db j ects are selected by" a user , 
5 which items are considered by a user according to the 

amount of Time the cursor hovers over the items, measuring 
the time of presentation" of an element in various ways, 
and/ of "activating hyperlinks 

The tracked interactions are preferably logged to a 
10 local memory by a downloadable Web browser applet embedded 
in the Web page, such as a program written in an 
interpretive language such as Java™. (Java™ is a 
trademark of Sun Microsystems Corporation of Sunnyvale, 
California. ) 

15 T he— logge d-interactions— as stored in the local memory 

file are then -sen t~tO"a~remd^t^"s1^rver r at appropriate <times. 
For exairple-^in-the^ preferred embodiment > the logged ^ 

l - - - - .— ■ „- _. - — ■ ■ - 

interaction informatics may be included^ in 7a "dummy" HTTP 
GET^mes s age^OTt_byL-the^c 1 i en t ~ t o — t he ^s e rver— at - the^ Jtifne 

20 the—applet i"s~ taken "down, such as when the user requests 
that aT next page be displayed. 

The logged interaction information may be flushed in 
other ways, such as by sending a POST message to the server 
either periodically or upon occurrence of certain events. 

2 5 The in ven t x on therefore permits the tracking! of user 

interaction^ with la JWeb lp bef ore^ 

si^sequent^i^trions-, such as loading^tKeirax^ertiser ' s home 
Web page, occur . For "exairiple , the^ applet may intercept/ 
multiple interactions such" as mouse - clicks on objects to, 

30 further^ qualify. a_ user beTf ore ^ T^dirig™a -specif ie one -of the 
advertiser # s own home Web pages . } 
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, As^ a Tesiilt; the advertiser may obtain information, 
about, what - interests _the-^user— without^ the . user Jiaving to 
leave the originally displayed Web page or performing other 

tasks^wh±ch~ar^perGeived as being cumbersome^ and/or ~ 

_______ . > 

5 distracting" from what the user w^l originally: doing . 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features, and 
advantages of the invention will be apparent from the 
following more particular description of preferred 
10 embodiments of the invention, as illustrated in the 

accompanying drawings in which like reference characters 
refer to the same parts throughout the different views. 

FIG. 1 is a block diagram of a distributed computing 
system illustrating a manner of tracking user interaction 
15 with a Web page according to the invention. 

FIG. 2 is a flow chart of the operations performed by 
an applet program according to the invention. 

FIG. 3 is a typical Web page display illustrating how 
the invention may prequalify a user. 



20 DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

FIG. 1 is a block diagram of a distributed computing 
system 10. The distributed computing system 10 includes a 
number of computers 12, 20 interconnected by a 
communication media 14. The communication media 14, and in 

25 general the distributed computing system 10, may make use 
of any number of computer networking techniques such as 
local area networks (LANs), routers, dial-up connections, 
and/or other data communication techniques to form what has 
become known as an "intranet" or "internet." In the 

30 preferred embodiment, the present invention is employed in 
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what has become known as "the Internet, " which is an 
international computer network linking many millions of 
computers . 

Typically the computers 12, 20 are personal computers, 
5 mini-computers, or the like. Certain of the computers in 
the distributed computing system 10 act as servers 12a, 
12b, and are used primarily to store and supply 
information. One type of server 12a which is in widespread 
use on the Internet is known as a Web server that provides 
10 access to information stored in a form known as a Web page 
16. 

Other computers in the distributed computing system 10 
known as clients 20a, 20n are typically controlled by 

one user. The typical client computer 20a includes, as for 

15 any computer, a processor 22, a memory 24, and a display 

26. The client computers 20 allow a user to view Web pages 
16 by "downloading" replica Web page files 40 to the client 
computer 20a from the server computer 12a over 
communication media 14. The Web page files 40 enable 

20 replication of the Web page 16 on the client computer 20a. 
The downloading function is specifically performed by a 
browser program 28, which preferably includes browser 
program software such as Netscape Navigator™ or Microsoft 
Internet Explorer™. (Netscape Navigator™ is a trademark 

25 of Netscape Communications Corporation of Mountain View, 
California, and Internet Explorer™ is a trademark of 
Microsoft Corporation of Redmond, Washington.) These 
browser programs include and/or permit the use of embedded 
interpretive languages 30, such as Java™, that may execute 

30 programs that are included in the Web page file 16. 

The browser program 28 thus enables the user to create 
a view of the Web page 16, such as in a window 34 on the 
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display 26. It should be understood that other windows 35 
and other programs 36 may relate to other pl^ograms 31 that 
the user is presently running oh the processor 22. In . 
order to display the Web page 16, the browser program 28 
5 typically downloads the Web page files to its local memory 
24, storing it as a local replica 40. The Web page replica 
40 includes various portions such as a Hypertext Markup 
Language (HTML) as well as other instructions for the 
Browser program 28 to format the Web page information in 

10 the window 34. 

The Web page replica 40 also includes Java™ code 44 
that includes instructions to be ran while the user 
computer 20a is displaying the Web page. 

The display of the Web page replica 40 in the window 

15 34 may include various regions such as a user input area 37 
where the user enters addresses of Web pages that he or she 
desires to view, and menus 38 for other actions associated 
with operating the browser program 28 itself. 

Of interest to the description of the present 

20 invention is a Web page replica 40 that contains at least 

one advertisement area 39. The advertisement 39 on the Web 
page replica 40 is typically created by the provider of a 
service or product manufacturer. The advertisement 39 is 
typically used as an enticement for the user to download 

25 other Web pages specifically associated with the originator 
or author of the advertisement 39. 

In. accordance ¥i tg ; th^ li^nQo^the Java™ ^ode^44 
includes an^aj^l^t;^^ tracking and 

logging jthe^activi ties of the 7!us^r~i"n - memory 24 -while the 

3 0 user is viewi-ng~~the Web page replica 40. The Tappligt 
program^ 4 there' f or e permits the~fMIthor s ~of the 
advertisement^ understand liow the^users ^ 
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interact- with 7the Web page advertisement in order) to 
provide more effective advertising . 

More specifically, the Web page replica 40 includes 
the Java™ code applet 44 that describes the particular " 
5 attributes of the advertisement 39. Once the Web page 

replica 40 begins to display, the applet 44 also begins to 
execute in order to track and/or log user activities as 
they relate to various parts or objects of the 
advertisement 39. 

10 For example, the applet 44 may include information 

that describes regions 46 of the advertisement 39, a list 
of visual elements 48 associated with the advertisement 39, 
and/or user activity definitions 50 that may take place 
within the context of the advertisement 39. The regions 46 

15 may define areas within the advertisement 39, such as areas 
devoted to text or graphics. The elements 48 within the 
advertisement 39 may include various graphical images. The 
elements 48 may also include user prompts such as buttons, 
menus, slide bars, radio buttons, and the like. 

2 0 The irs t^of ~ac t iVi ty _ de f ini t i ons.-5 CLmay- inc lude) 

various types ~o£ u^ The jnost: ii^ortant user input 

i s typically "iro^se ^ 

of a cursor 337IL^tIthese„may also include other user 
inputs such as mouse clicks^ or_ keyboard" inputs .) 

25 FIG. 2 is a flow chart of the operations performed by 

the applet 44 in the process of tracking user interactions 
with the advertisement 39. An initial state 100 is entered 
when the applet is first started. This typically occurs 
when the user requests the display of the Web page 16 and 

30 the replica 40 has been downloaded or has at least begun 
being downloaded from the server 12a. 
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In the next state 101, the applet program 44 begins 
execution on the client computer 20a. This is typically in 
the context of an interpretative language such as the 
Java™ language executed within the browser 28. However^ 
5 it should be understood that the applet may be implemented 
in other ways, as long as the applet 44 has access to the 
appropriate user inputs and local memory 24 for the logging 
of user activities with respect to the advertisement 39. 
In the next state 102, the applet 44 establishes a 
10 local list of elements and regions on the Web page replica 
40 associated with the advertisement 39 that are of 
concern. 

A next state 104 is then entered in which user 
activities with respect to objects within the advertisement 

15 39 may begin to be tracked by logging information in local 
memory locations 24 at the client 20. From this state 104, 
any number of states 106 through 114 and/or state 118 may 
be next entered for any given element 48 . 

For' Example, in state , 106, the . eiapsed. time that . thej 

20 element 48 has been displayed on the^page r is^ tr acked . 

In state 108 ,_ the fact that the "mouse hovered hear an 
element— 48'r i~reT,""the~f act—that the user moved the -mouse 
within a region 46nDf ^^ element 
48 but did-not actually click on the element, is tracked. 

2 5 In s t a te 1 1 0 , the f ac t~ tha t the- us er c li clced; on an 

element 48- is -tracked.^ rt_should-be~noted_that^ this may 
include the tracking of one or more mouse clicks^ on one^ or 
more elemenj^j£j$^by_^ log 60. 

Thus, -unXike the^stahdard operation of an HTML hyperlink, a 

30 single mouse click may not" ne^^ 

to the -loading^of' the~next Web page 16. 
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In state 112, the applet 44 tracks cursor 33 location 
at the moment of a mouse click with respect to the element 
48. 



rlnTTanotHer^state 1147 the applet 44 may adjust the 
5 time""f raine associated with the particular action being ifc 
logged . For ex am ple, when the user initially views a Web 
page 40, certain activities such as cursor 33 location may. 
be" tracked in short-time intervals such as microseconds. 
However , other items such as the elapsed time an element ,48 
10 is displayed on the page may be tracked in longer time J 
intervals" such as seconds. Certain items such as cursor- 
hover time may initially be tracked in a microsecond time : 
frame, and then, depending upon the amount of time the; 
element has been displayed, will switch to tracking, a 
15 longer time interval, sucE as seconds^ 

In state 116, the fact of the user "requesting a 
different Web page. is__tracked. ^ 

It should be understood that, in states 106 through 
114, data associated with the various user activities is 
20 logged in a portion of the memory 24 associated with 
maintaining an activity log 60. 

Eventually, a state 118 is reached in which the user 
indicates that he or she wishes to leave the present page 
40. This event is typically associated with loading 
25 another page in state 116 or may also include the closing 
of the browser program window 34. 

At certain times, state 120 is entered in which the 
activity log 60 is sent from the local memory 24 by the 
applet 44 back to a server 12b. The server 12b is 
30 typically associated with the advertiser, or an 

advertisement rating service. This server 12b may or may 
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not be the same server 12a from which the Web page 46 was 
originally downloaded. The applet 44 may then terminate. 

In the preferred implementation of state 120, the 
activity log 13 is sent to the server 12b via a "dummy" 
5 HTTP GET message sent via a "back channel" to the server 
12b at the time that the user leaves the present page 40. 
In particular, this back channel is a second network 
connection, different from the network connection used to 
fetch the Web page and download the applet in step 100. 

10 The dummy message is encoded as an HTTP GET with 

interaction log data shared in the GET message in such a 
way as to appear to be part of an extended address, for 
example. Thus, the browser program 28 does not need to 
perform any special functions or otherwise be modified. 

15 However, the interaction log data may also be sent at 

other times. For example, while the advertisement is being 
displayed, the applet may periodically open a back channel 
connection and send a POST message to the server 12b. 
Alternatively, certain events may trigger sending the 

20 logged interaction data, such as when the user clicks on a 
particular part of the advertisement 

What is important is that the logged interaction data 
is eventually flushed to the server 12b, so that the author 
of the advertisement 39 may occasionally check on the 

25 collection 62 of activity logs stored at the server 12b and 
analyze the data in order to determine the effectiveness of 
the advertisement 39. 

FIG . " 3~~i s~a vrew~o f aT Web page' such as^ that ^ produced 
by ^a search engine such as Yahoo™ . The advertisement 39 

30 is typically displayed in a defined region on the Web page 
40 . In this example, the effectiveness of the 
advertisement 39- associated with the advertiser who is in. 
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the running shoe business Is being tracked.. In the 
example, the applet 44 tracks how long a user allows the 
mouse cursor 50 to hover near one of the eight possible 
displayed selections for running shoes. The applet 44 also,. 
5 tracks the position of the mouse to determine which one or- 
more'of the running shoes is selected by user-activated 
mouse clicks. Thi^s information is then sent to the logging 
server 12b and is used prior to loading the manufacturer's 
Web page. Thus, the relative interest in a particular type 

10 of shoe may be gauged before the advertiser's Web page is 
loaded or, indeed, a lack of interest, in particular lead 
or "teaser" items, may be determined prior to the user 
requesting that the manufacturer's Web page be loaded. 
It is now understood how the invention provides 

15 various advantages over the prior art. In particular, the 
invention includes an applet 44 that is downloaded together 
with a Web page 40 (Web page files) capable of logging the 
user's interactions with elements 48 on the page. The 
applet in particular logs user interactions with the page 

20 40 that indicates user interest to an advertiser. By> 
identifying regions "oh the page a nd then tracking user 
activity and relating it to the particular elements or 
regions on the page, the advertiser may therefore more 1 
effectively evaluate the effectiveness of particular; 

25 objects in the advertising. 

By collecting the interaction data locally and then 
sending them to a server which logs data locally via a back 
channel, the operation of the client computer or data 
stored thereon need not be permanently modified. 

30 By tracking multiple interactions before loading the 

advertiser's own Web page, the advertiser may prequalify a 
user and hence customize or tailor information to be 



WO 99/13423 



-13- 



PCT/US98/18619 



displayed. In turn, tfie advertiser may more effectively 
present the information once the advertiser's Web page is 
requested by the user. ^ 

The user- may also^ be enticed to interact with a Web 
5 page advert i, semen t ,^-thereby- disdlosing: inf ormation about 

the user' sjxn teres ts, — without±heir actually requesting the 
loading- of Web pages associated with the advertiser. ' 

EQUIVALENTS 

While this invention has been particularly shown and 
10 described with references to preferred embodiments thereof, 
it will be understood by those skilled in the art that 
various changes in form and details may be made therein 
without departing from the spirit and scope of the 
invention as defined by the appended claims. Those skilled 
15 in the art will recognize or be able to ascertain using no 
more than routine experimentation, many equivalents to the 
specific embodiments of the invention described 
specifically herein. Such equivalents are intended to be 
encompassed in the scope of the claims . 
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CLAIMS 

What is claimed is: 

1 . In a distributed computing system for displaying 
information, a method comprising the steps of: 

5 displaying to a user a representation of an 

advertisement in electronic form; 

tracking user interaction with the advertisement; 
logging the user interactions while the 
advertisement is being displayed to the user; and 
10 sending interaction log data to a remote server. 

2. A method as in claim 1 wherein the interaction log 
data is sent to the remote server when the display of 
the advertisement is terminated by the user. 

3 . A method as in claim 1 wherein the interaction log 

15 data is sent to the remote server upon the occurrence 

of a user interaction with the advertisement. 

4. A method as in claim 1 wherein the interaction log 
data is sent to the remote server periodically. 

5 . A method as in claim 1 wherein the step of sending 

20 interaction log data additionally comprises the steps 

of: 

opening a connection to the remote server; and 
sending a message to the remote server over the 
connection, the message containing the interaction log 
25 data. 
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6 . A method as in claim 5 wherein the message is an HTTP 
GET message. 

7 . A method as in claim 6 wherein the interaction log 
data is encoded as to appear as part of an extended 

5 address field in the HTTP GET message. 

8 . A method as in claim 1 wherein the interaction log 
data includes mouse position and time of mouse 
hovering over advertisement. 

9 . A method as in claim 1 additionally comprising the 
10 step of: 

downloading the advertisement from a second 
server different from the remote server. 
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